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ABSTRACT 

The computer-assisted instruction (CAI) program in 
undergraduate organic chemistry at the University of Texas was 
evaluated by an experimental design in 1969 and found to be 
successful. This report discusses in detail the foinnation of the 
design, its application, and the method of evaluation. The program 
Itself included 15 teaching modules that dealt with a variety of 
organic chemistry topics. (MC) 



THE UNIVERSITY OF TEXAS AT AUSTIN 

G^mputer Assisted Instruction Laboratory 

AUSTIN 



COMPUTER-ASSISTED INSTF.UCTION IN 
UNDERGRADUATE ORGANIC CHEMISTRY: 
DESIGN, APPLICATION, AND 
EVALUATION 



TECHNICAL REPORT NO. 10 
George Gulp 



U S. DEPARTMENT DF HEALTH 
EDUCATION ft WELFARE 
OFFICE OF EDUCATION 
■mrs DOCUMENT HAS BEEN REPRO- 
OUCEO EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIG- 
INATING IT POINTS OF VIEW OR OPIN- 
IONS STATED DO NOT NECESSARItY 
REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POUCY 



August 1971 



Supported By: 

THE NATIONAL SCIENCE FOUNDATION 
Grant GJ 509 X 



The University of Texas at Austin 
Computer^Assisted Insovuetion Laboratory 
C. Victor Bunderson^ Director 
Austin^ Texas 78712 



COMPUTER-ASSISTED INSTRUCTION IN UNDERGRADUATE ORGANIC 
CHEMISTRY: DESIGN, APPLICATION, AND EVALUATION 



Introduation 



Computer techniques applied to instructional processes have for 
some time been recognized as a valuable educational tool. In the early nart 
of the decade of the Sixties, initial efforts in computer-assisted Instruc- 
tion (CAI) applications were made in such disciplines as mathematics and 
physics. Since then, increased research efforts have characterized this 
mode of instructional aid. 

In 1965 Lagowski and co-workers at The University of Texas at Austin 
first began the development of several short computer programs that were 
primarily of chemistry laboratory simulation. In the following two years 
workers at the University of Illinois, University of Maryland, and Florida 
State University also opened developmental efforts of short, simulation- 
type CAI programs. It was not until 1968, however, that CAI programs in 
undergraduate chemistry were evaluated under carefully controlled conditions 
and in an educational environment. The studies were conducted under the 
direction of Professor J. J. Lagowski at The University of Texas at Austin 
by Castleberry (1970) and Gulp (1970). 

A description is presented here of two related follow-up studies 
to the original experiment using computer techniques in undergraduate organic 
chemistry instruction. t ^ 

Design 

The original CAI modules were: 

1. Structure and Geometry of Alkanes. 

2. Skeletal Isomerism of Alkanes and Stereoisomerism of 
Cycloalkanes . 

3. Nomenclature: Alkanes and Cycloalkanes. 

4. Preparations of Alkanes. 

5. The Chlorination of Ethane: Mechanism. 

6. The Halogenation of Alkanes: Relative Reactivities and 
Stabilities. 



7. Stereochemistry Fundamentals. 



8. Alkene-related Syntheses. 

9. Electrophilic Aromatic Substitution-^related syntheses. 
These modules were increased to include: 

10. Preparations of Alkenes. 

11. Reactions of Alkenes. 

12. Preparations and Reactions of Arenas. 

13. Alcohols: Reactions and Syntheses. 

In addition, two more modules were developed, but they lack fuU-scale eval-> 
uation at this date: 

14. Elementary NMR Interpretations. 

,15. Elementary Organic Qualitative Analysis. 

The philosophy underlying the development of these modules is the 
belief that, as with any discipline, there are certain concepts In organic 
chemistry in which the responsibility for learning is placed primarily upon 
the student in a self-instructional mode. These areas, for the most part, 
do not require the presence of an instructor but, nonetheless, are critical 
for the attainment of mastery of the discipline. It is also true that often 
the logistics of time and student enrollment number shift the responsibility 
of necessary drill, practice, and tutorial tasks from the instructor directly 
to the student. Again, the burden of responsibility weighs heavily upon the 
student. 

Thus the modules are an attempt to utilize programs developed for 
CAT in hopes of supplying the needed drill, practice, and tutorial aid for 
certain of the areas studied in organic chemistry. In essence, the entire 
program is one in which a number of students, limited only by time and the 
availability of CM facilities, will have the opportunity to converse with 
persons knowledgeable in organic chemistry via high-speed electronic computers, 
The task of responsibility for supplying this needed tutorial drill and prac- 
tice to the student is thus placed within the command of a knowledgeable per- 
son and his guiding influence. 

of Essentially, each of the modules was designed following a modification 

of the pattern described by Lange (1967): 



,, Initial design of 

yrm . !)pecifioation oj- behrxoioml aruihjsio and 

deftmtton behavzoral ohgeabives inetmctu,mU sequence ' 

Initial oonetruo- Student 

Hon or the program testing ^ > i.-evieion ^ 

Random stu- 

dent selection . Utilization , , Revision ^ Evaluation 

The modular content design is consistent with Skinner's operant 
onditioning: 

Stimulus »■ Response Reinforcement ^ Stimulus 

and the design, in most cases, also parallels Gagng's (1965) Hierarchy of 
Learning Tasks: ^ 

Response _ _ Multiple Behavior' 
leamtng Assoo^at^ons »- discriminations ^ chaining ^ 

Class 

concepts »■ Principles 

Several of the modules were designed so that a student may ask for 
aid repeat a question, transfer to other areas, or stop the interaction as 

30-45 SnTte": °' "'^^ approximately 

Application 

asks the''foffol\n? q'^^^^^ '""'^"'^^ utilization primarily 

Can such a program effectively supply needed drill, practice, 
and tutorial assistance for the student? 

2. Can such a program yield evidence that it is beneficial to 
the student? 

«nn^4.!I;i^''^.°^ "^^^ ^ P"Sram appear to be most effectively 
applicable to student utilization? '-■•-vcxy 

4. Will the student willingly participate in the program? 

5. What attitudes will a student develop toward such a program? 
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ExpeHmental Design 

In anticipation of gaining insights toward these questions, an 
experimental design was erployed. The 1969 fall semester clkss of 
Chemistry 810a at The University of Texas at Austin, composed of stu- 
dents majoring in pre-med, pre-dental, science other than chemistry, etc. 
was divided by random selection into two groups of 50 students each. 

The expeHmental group, in addition to their normal class activi- 
°i 50-minute lecture sessions and one 4-hour laboratory session 

per week, were given access to the CAI modules for interaction at their 
convenience (within the schedule limitation of MWF 6-10 p.m. and TT 1-4 
p.m.) The control group participated only in the conventional class 
activities. Comparison of groups was between experimental group CAI users 
experimental group CAI non-users, and the control group. ^ ^ 

The 1970 spring semester class of Chemistry 818a, composed of stu- 
dents majoring in chemistry or chemical engineering, was divided by labora- 
tory section into the following four groups: 

(1) CAI users, who were required to interact at least one hour 
per week with the computer modules. 

(2) and (3) TAl (teaching assistant) and TA2, who were required 
to meet for one 50-minute session per week with their respective 
TAs for tutorial drill similar to that provided by the CAI modules, 
plus question and answer sessions as questions may arise on other 
topics. 

(4) Control, who participated only in the conventional activities 
of the class (similar to those described above for Chemistry 810a). 

Comparison of groups was between CAI users, combined participants of the 
TA sessions, and the control group. 

Evaluation 

Method 

For the 1969 fall semester class of Chemistry 810a, the method of 
evaluation was based upon a statistical t test analysis of the means of 
items on examinations that were either directly related or unrelated to 
the niaterial presented in the CAI modules. The means of the Experimental 
Group CAI Users. Experimental Group CAI Non-Users, and the Control Group 
were compared. vruup 

For the 1970 spring semester class of Chemistry 818a, a statistical 
t test was again employed to test for differences on items of direct. 
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indirect, and no relationship to the material in the CAI modules between 
the CAI, TA, and Control Groups. In addition, a comparison of subjectiv( 
student attitudes was performed between the CAI and TA groups. 



The results of examination score performances, which are listed 
in Table 1, for the Chemistry 810a class on items of direct and no relation- 
ship to the CAI material indicate that CAI exerts a positive influence on 
score performance. The Experimental Group CAI Users scored consistently 
and signif-icantly higher than the Experimental Group CAI Non-Users on five 
of five examinations, including the final examination, and on three of five 
examinations, including the final examination, when compared with the ControJ 
Group. A statistically significant difference in favor of the CAI group 
for unrelated items, however, occurs only on two of five examinations when 
compared with the Experimental Group CAI Non-Users,, and only on one of five 
examinations when compared with the Control Group. The semester average of 
performances on related items, after conversion co a 100-point basis, also 
indicates a statistically significant difference in favor of the CAI Users 
over Experimental and Control Group Non-Users of CAI. A significant differ- 
ence is absent, however, for unrelated items. The average terminal sign-on 
time was 6.20 hours per student. 

Positive influence of CAI participation on score performances is 
also exhibited by the results of examinations for the Chemistry 818a class. 
These effects appear in Table 2. The CAI group scored consistently and 
significantly higher than the TA and Control Groups on items of direct 
relationship to CAI/TA interactions on aj 1 examinations, cxcludlnK Hour 
Exam I and the Final Examination. The former results are no doubt explained" 
by the fact that a lengthy quiz that included coverage of all CAI-rolated 
items was given one week prior to Exam I. The CAI group did show a sig- 
nificant difference from the other groups on related items for this quiz. 
The results of the final examination are more difficult to account for, 
but may partly reside in the stronger background ability of the Control 
Group, as indicated by their SAT verbal and quantitative scores. As with 
the 810a class, the semester mean of related items following conversion 
to a 100-point baais indicates a significant difference in favor of the 
CAI group, whereas no difference exists for unrelated items. Additional 
support for CAI is shown in Table 3. The students in the CAI group con- 
sistently indicated a greater positive opinion for CAI-type assistance 
over teaching assistants. This probably reflects the varying abilities 
of the TAs and the influence of individualized instruction exhibited by 
CAI . ' 

The areas of Nomenclature, Organic Reactions, and, in particular. 
Organic Syntheses, consistently proved to be the areas most effectively 
suited to CAI utilization, not only in score performances, but aJso stu- 
dent preference. The average terminal sign-on time was 11.20 hours per 
student. 
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Table 1 



Mean Score Pevfomanoes for- Examination Items Related 
and Unrelated to the CAI Modules 



Chemistry 810a, Fall 1969 



Related items 
Point 



76 



II 



III 



IV 



62 



30 



15 



Final 189 



Sem. 
Ave. 



100 



Group 


X 


_N 


Exam 


CAI 


'37.56^ 


39 




Cont 


54.89 


47 


1 


NU* 


49.27 


15 


CAI 


42.211.2 


24 




Cont 


37.722 


47 


II 


NU 


29.53 


30 




CAI 


24.00^.2 


26 




Cont 


21.682 


41 


III 


NU 


18.19 


16 




CAI 


10.792 


14 




Cont 


10.472 


38 


IV 


NU 


7.74 


31 




CAI 


118.591/2 


22 




Cont 


108.402 


40 


Final 


NU 


94.77 


13 




CAI 


71. 70 1/2 


22 




Cont 


66.502 


40 


Sem. 


NU 


54.97 


13 


Ave. 



Unrelated items 
Point 



24 



38 



70 



85 



IIJ 



100 



Croup 


X 


N 


CAI 


'M) 'J ft 




(Joiit. 


'?Vi 1 7 


li 7 
'1 / 


NU* 


19 40 

< ^ • "TV/ 




CAI 


31.00 


24 


Cont 


29.85 


47 


NU 


n.n 


"30 


CAI 


46.962 


26 


Cont 


43.612 


41 


NU 


37.00 


16 


CAI 


65.641/2 


14 


Cont 


59.372 


38 


NU 


50.35 


31 


CAI 


«5.36 


22 


ConL 


83.70 


40 


NU 


79.69 


13 


CAI 


77.442 


22 


Cont 


74.032 


40 


NU 


67.50 


13 



Average terminal time: 6.20 hours /semester/student 
*Students in the experimental group but x/no were Non-Users of CAI materials 
^Statistically significant difference from Control Group 
^Statistically significant difference from Non-User Group 



Group 

CAI 
TA 

Control 



Table 2 

/•fectn iloove Varfomances for Chemistry 8 Ida Croupu 
Chemistry 818a, Spring 1970 
Mean Uaakgromd Abi Li iy 
SAT Verbal SAT Quantitative Chemistry Placement 



555 
548 
563 



629 
621 
656 



Related items 



Examination Perfomance 

Indirectly 
related items 



36.4 
32.8 
35.3 



Unrelated items 



Point 
Exam Value Croup 



Point 







CAI 


53. 70^ 


20 


Q.l 


66 


TA 


44.46 


24 






Cont 


44.12 


40 






CAI 


24.96 


24 


I* 


36 


TA 


24.50 


24 






Cont 


25,07 


40 






CAI 


30.05' 


20 


£1 


48 


•J'A 


24.88 


20 






Cont 


25.85 


34 






CAI 


15. 89^ 


20 


III 


30 


TA 


9.41 


17 






Cont 


11.19 


31 






CAI 


42.22 


18 


Final 


97 


TA 


42.44 


18 






Cont 


41.60 


30 


Sem. 




CAI 


63.561 


18 


Ave. 


100 


TA 


54.07 


18 






Cont 


55.74 


30 



48 



38 



120 



100 









Point 








Group 


X 


N 


Value 


Group 


X 


N 










CAI 


22.70 


20 








34 


TA 


22.58 


24 










Cont 


22c09 


40 










CAI 


54.48 


24 








89 


TA 


57.03 


24 










Cont 


57.04 


40 


CAI 


26.60 


20 




CAI 


16.61 


20 


TA 


29.20 


20 




TA 


17.38 


20 


Cont 


26.20 


34 




Cont 


15.38 


34 


CAI 


23.10 


20 




CAI 


22.20 


20 


TA 


22.35 


17 


112 


TA 


26.41 


17 


Cont 


22.26 


31 




Cont 


25.35 


3J 


CAI 


67.27 


18 




CAI 


52.73 


18 


TA 


61.28 


18 


157 


TA 


50.45 


18 


Cont 


67.07 


30 




Cont 


63. 03^ 


30 


CAI 


57.42 


18 




CAI 


44.38 


18 


TA 


56.91 


18 


100 


TA 


45.72 


18 


Cont 


56.35 


30 




Cont 


45.81 


30 



Average terminal time: 11.22 hours/semester/student 

^Related items, and some unrelated items, were presented on Quiz 1, one week prior 
to Exam I. . ' 

^Statistically significant difference from group witli next lil«hc.si nt-an. 
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Table 3 

StAidert Opinion and Attitude by Group 



Chemistry 818a, Spring 1970 



Opinion CAi studants TA Students 

Crit e rion Agree Agree 

1. The time required wan of value. 8]% 587. 



2. Participation in the group was 95% 507. 

a. definite aid to learning. 



3, Optional participation in the 100% 83% 

group should be continued. 



4. Participation in the group was 86% 33% 

enj oyable. 



5. For any future studies, I prefer 77% 46% 

assignment to my current group. 



8 



liefarenceo 



Bigge, M. L., & Hunt. M. P. Pcyahologioal fomdatims of education. 
New York: Harper & Row, 1962. 

Castleberry, S. J., & Lagowski, J. J. Computer-assisted instruction 
for intioductory chemistry. J. CMm. Mm:, 1970, ^>7, 91-i04. 

Gagn6, R. M. The analysis of instructional objectives for the design 
of instruction. In R. Glasser (Ed.), Teaching mdiines and 
programed instruaticn, II, data and direotiono. Department 
of Audio-Visual Instruction, National Education Association 
of the United States, 1965, 23-65. 

Lange, P. (Ed.) Programed inatruotion. National Society for the Study 
in Education, 66th Yearbook, Chicago: University of Chicago Press, 



Rodewald, L. B., Culp, G. H. , & Lagowski, J. J. The use of computers in 
organic chemistry instruction. J. Chem. Educ, 1970, 47, 134-6. 



